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Program  Trends 


•Trust  in  Autonomous  Systems 
•Cross-cultural  Trust 
•Influence  Effects 

•Cognitive  Mechanisms  for  Influence  i=> 
•Computational  Methodsc^ 

•Modeling  , 
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w  2012  AFOSR  SPRING  REVIEW 

NAME:  Trust  and  Influence 

BRIEF  DESCRIPTION  OF  PORTFOLIO: 

Basic  research  to  explore  the  science  of  reliance  (i.e.,  how  humans  establish, 
maintain,  and  repair  trust  of  humans  and  technological  systems)  and  the  science  of 
influence  (i.e.,  understanding  how  to  shape  the  behavior  or  attitudes  of  others). 

LIST  SUB-AREAS  IN  PORTFOLIO: 

Science  of  Reliance 

•Cross-Cultural  Trust  -  Identify  the  antecedents  of  trust  in  different  cultures 
•Trust  in  Autonomous  Systems/Autonomy  -  identify  the  factors  that  shape  reliance 
in  complex  human-machine  interactions 

Science  of  Influence 

•Understanding  the  behavioral  effects  of  different  influence  tactics  (air  strikes, 
messaging,  developmental  activities) 

•Understanding  the  cognitive  mechanisms  that  drive  influence  effects  -  identify  the 
avenues  of  influence  for  different  groups 
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Trust  Background 


Trust  =  willingness  of  individuals  to  accept 
vulnerabilities  from  the  actions  of  others  with  little 
ability  to  monitor  their  actions  (Mayer  etai.,  1995) 

Assumptions: 

•Trust  is  a  human  phenomenon 

•Trust  &  trustworthiness  are  independent  (Mayer  et  al,  1995) 
•Trust  is  relational 

•Humans  in  cross-cultural  interactions 
•Complex  human-machine  interactions 
•Trust  is  dynamic  (Levine  et  al.,  2006) 

•Trust  is  only  relevant  in  the  context  of  risk  (Parkhe  &  Miller,  2000) 
•Trust  has  both  affective  and  analytical  underpinnings  (McAllister 
et  al.,  1995;  Lount,  2010;  Stokes  et  al.,  2011) 
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Motivation  -  Trust 


AF  Tech  Horizon’s  2010 

“In  the  near  to  mid-term,  developing  methods  for  establishing  ‘certifiable  trust  in  autonomous 
systems’  is  the  single  greatest  technological  barrier  that  must  be  overcome  to  obtain  the 
capability  advantages  that  are  achievable  by  increasing  use  of  autonomous  systems”  (p.  42) 

Operational  Challenges: 

•Future  battle  ground  -  complex  human-machine  interactions 
•Interactions  with  other  cultural  groups  -  where  trust  will  be  critical  as  HUMINT 
increases  in  value  -  partner  capacity  service  core  function  (Schwartz,  2011) 

Science  Challenges:  Appropriate  reliance  is  really  hard! 

•Complacency  and  or  under  reliance  are  common  pitfalls 
•Automation  often  has  unintended  consequences  (Parasuraman  &  Riley,  1997) 
•Automation  paradox  -  reliable  automation  can  lead  to  catastrophic  error 
•Interpersonal  trust  models  are  based  on  “Western”  data/models 
•Humans  have  trust  biases  (Lyons  &  Stokes,  2012) 

•Little  is  known  about  how  human  trust  principles  apply  to  autonomy 

Opportunities: 

•Identify  human-centric  trust  vulnerabilities  before  fielding  autonomous  systems 
•Support  AFCLC  cultural  competencies  -  trust  building 
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Trust  Domain/Scope 


Interpersonal  Trustworthiness 
•Ability 
•Benevolence 
•Integrity 


Autonomous  Systems  & 
Automation 


Trust  Metrics 


Human-Machine  Interactions 


Cross-Cultural  Trust  Issues 


Human  trust 


Human  Trust  Biases/Vulnerabilities 
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Stokes  -  Dynamic  Trust  Model 


PI:  Charlene  Stokes  (AFRL)  Lab  Task 
Drs.  Lin  (Sunway  U)  and  Chen  (NICTA) 

Objective:  Examine  contextual  factors 
that  influence  trust  and  trustworthiness 
•Relationship  type,  load,  culture 

Approach:  Manipulate  trustworthiness 
and  cognitive  load  in  an  applicant  scenario 
using  US,  Malaysian,  &  Australian  subjects 

Results:  Australian  data  collected  (N=73) 

•Load  manipulation  effective 

High  M:  3.625,  Low  M:  3.037;  f(72)=5.201 ,  pc.01 

•Trustworthiness  dimensions  uniquely 
influence  selection 
•The  unique  influence  diminish  under 
high  cognitive  load 

•Dispositional  influences  stronger 

DISTRIBUTION  A:  Approved  for  public  release;  distribution  is  unlimited. 


LowCL  Condition 

%  of  time  selec 
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ted  for  position 

Applicant 
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Other's 

Supervisor 
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Ability 
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0.175 
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Benevolence 

0.513 
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0.250 

Integrity 

0.238 

0.575 

0.175 

Neutral 

0.000 
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0.000 
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1.000 
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V  ^  Atkinson  -  Role  of  Benevolence  in 
♦•f  Trust  of  Autonomous  Systems  ^§jp 


PI:  David  Atkinson  (IHMC) 


Objective:  Experimentally  evaluate  the 
Impact  of  benevolence  within  a  human- 
machine  interaction 

•Interpersonal  trust  and  trust  in  automation 
models  have  been  treated  as  orthogonal 

Approach: 

•Operationalize  “benevolence”  in  an 
autonomous  system  scenario 
•Evaluate  the  impact  of  benevolence  using 
experimental  methods 

Collaborators: 

•Peter  Hancock  (UCF) 

•Deborah  Billings  (UCF) 

•Robert  Hoffman  (IHMC) 


DISTRIBUTION  A:  Approved  for  public  release;  distribution  is  unlimited. 


9 


Motivation  -  Influence 


Lt  Gen  Flynn  (Nov  2011) 

Need  to  understand  the  “Precursors  of  war”  -  what  are  the  triggers  for  attitudes  and 
behavior  in  different  parts  of  the  world 


Operational  Challenges: 

•DoD  lacks  precision  in  cultural-based  influence  -  a  science  base  is  needed! 

•Military  Information  Support  Operations  (AF  IFO  Roadmap,  May  2008) 

•Target  audience  analysis  is  a  top  MISO  requirements 
•Air  Force  Targeting  Center  -  quantification  of  behavioral  effects  for  influence 

Science  Challenges: 

•Manipulation  of  influence  tactics  not  plausible  in  practice  -  but  maybe  in  the  lab 
•Rational  actor  models  may  not  generalize  beyond  the  laboratory  -  need  field  research 
•Data  mining  and  modeling  tools  have  outpaced  theory  in  social  media  research 

Opportunities: 

•  Revolutionize  “targeting”  within  the  AF  -  quantify  hidden  costs 

•  Support  AFSOC/ACC  need  for  cultural  awareness  (e.g.,  AFRICOM) 
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Influence  Domain/Scope 


rV  Action 

N°n-Kinetic 

Operations 
1  Buildinq 


DISTRIBUTION  A:  Approved  for  public  release;  distribution  is  unlimited. 


V  4  Lyall:  Terrorism,  Governance,  and 

Development 


PI:  Dr.  Jason  Lyall  (Yale) 

Lead:  Jacob  Shapiro  (Princeton) 

Objective:  Evaluate  the  impact 
of  Kinetic  versus  Non-Kinetic  actions 
on  subsequent  violence 

Approach:  Working  with  CENTCOM, 
identify  unclassified  data 
and  used  a  matching  algorithm  to 
compare  villages  in  Afghanistan 
before  and  after  an  event 
•Matched  on:  geography,  pre-existing 
violence,  economic  indicators,  etc. 

Results: 

•Kinetic  actions  led  to  higher 
retaliation  but  the  effects  were 
limited  to  5km  radius 


Type 

15-day 

30-day 

60-day 

90-day 

Damage 

.369* 

.542f 

1.041* 

2.121** 

+9% 

+12% 

+15% 

+19% 

No 

Damage 

,182f 

.164 

.359 

.908 

+6% 

+5% 

+5% 

+7% 

DV:  Changes  in  mean  number  of  insurgent  attacks 
against  ISAF  in  specified  temporal/spatial  window 
Based  on  (Lyall,  2011) 

Impact:  Results  transitioned  to  the  Air 
Force  Targeting  Center/ACC  and 
briefed  to  CENTCOM 
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Matsumoto  -  Emotions  and 
Intergroup  Relations 


PI:  David  Matsumoto  (SFSU) 

Co-PI:  Mark  Frank  (SUNY  Buffalo) 

Objective:  Evaluate  the  role  of 
emotions  in  predicting  violent  acts 
•Emotions  trigger  action  tendencies 
•Anger,  contempt,  disgust 

Approach:  Examine  key  leader 
speeches  describing  in/out  groups 
prior  to  acts  of  violence 
•Code  emotions  in  text 

Results:  Acts  of  aggression  were 
preceded  by  increased  anger, 
contempt,  and  disgust 


Croups  that  Committed  Acts  of  Aggression 


time 


Croups  that  did  NOT  Commit  Acts  of  Aggression 


time 
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i  b  ARTIS  -  MUTUAL  INFLUENCE  OF  MORAL 
VALUES,  MENTAL  MODELS  AND  SOCIAL 
«•♦  DYNAMICS  ON  INTERGROUP  CONFLICT 


PI:  Scott  Atran,  Rich  Davis,  Jermy  Ginges 

Objective:  To  examine  how  conflict 
impacts  the  relationship  between 
religiosity  and  moral  absolutes 
•Religious  acts  may  anchor  sacred  values 
•This  process  could  be  triggered  by  threat 

Approach:  Surveyed  Palestinians  on 
attitudes  toward  Israeli-Palestinian  issues 
•Recognition  of  Israel  as  Jewish  State,  right 
of  return  for  refugees,  sovereignty,  etc. 
•Assessed:  religiosity,  perceived  conflict, 
and  moral  absolutism 

Results:  Conflict  intensifies  commitment 
of  religious  devotees  to  sacred  values 


Figure  1.  Likelihood  Of  Being  a  Moral  Absolutist  (%) 
Depending  On  Religiosity  And  Perceived  Threat  to 
the  Palestinian  People  (+/- 1  SD). 


Impact:  Prior  research  on  sacred  values  has  been  presented  to  Congress,  DARPA, 
House  of  Lords,  Dept  of  State  -  and  published  in  top-tier  journals  (e.g.,  Science) 
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PI:  Greg  Bums  (Emory) 

Objective:  To  assess  the  cognitive 
processing  sacred  decisions 

Approach:  Used  fMRI,  exposed 
subjects  statements  varying  in 
sacredness 

•“I’m  a  dog  person;  I  believe  in  God” 
•Offered  subjects  money  to  sign  a 
document  contradicting  their  value 

Results:  Statements  identified  as 
sacred  evidenced  rule-based  activity 
whereas  bid  statements  showed 
utilitarian  activity 

Impact:  Transitioned  to  DARPA 
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PI:  Robert  Axelrod  (Michigan) 

160 

Objective:  Examine  the  use  of  analogies 
and  exemplars  within  different  cultural  1 40 
groups  120 

•Examine  cultural  sensemaking/ 
narrative  -  historical  references  1  oo 

•Salience,  similarity,  compellingness 

80 


Approach:  code  newspapers  after 
significant  events  to  examine  use 
of  historical  cases  40 

•9/11 ;  Arab  Spring;  Osama  Letters 

20 

Results: 

•Wide  variety  of  historical  analogies  used  0 
•Varies  by  geography 

•Cases  more  salient  when  more 
proximal 


Following  9/11 


New  York  New  York 
Times  -  Times  - 
Opinion  Front 

Pieces  Page 


■  Mentions 

■  Cases 

■  Deny 

■  Avoid 

■  US  involved 

■  Terrorist 
attack 

Middle  East 

■  Historical 
Analogy 

■  post  WWII 
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w  Axelrod  -  Case-based  Influence 


Demonstrations  in  Egypt  2011 

■  Mentions 

■  Cases 
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UCLA  MURI  -  Inferring  Structure  and 
Forecasting  Dynamics  on  Evolving 

Networks 


PI:  Kristina  Lerman  (USC) 

MURI  Lead:  Jeff  Brantingham  (UCLA) 

Objective:  Examine  the  utility  of  social 
network  analysis  metrics  for 
understanding  influence 

Approach:  (sample) 

•Examine  utility  social  networks  using 
DIGG 

•Influence  =  re-posting 
•Alpha  Centrality  vs.  Page  Rank 

Results: 

•Alpha  Centrality  better  predictor  of 
influence  than  Page  rank  for  more 
local  network  structures 


DISTRIBUTION  A:  Approved  for  public  release;  distribution  is  unlimited. 


18 


UCLA  MURI  -  Inferring  Structure  and 
Forecasting  Dynamics  on  Evolving 

Networks 


PI:  Jeff  Brantingham  (UCLA)  &  team! 

Objective:  Use  mathematical  models 
and  statistics  to  forecast  patterns  of 
violence  in  LA  gangs 

Approach: 

•Apply  statistical  models  to  gang 
activity 

Results: 

•Model  indentified  dyadic  rivalry  as 
most  violent  -  supported  by 
actual  crime  data 

Impact: 

•Used  by  Predictive  Police  Unit 
•Used  by  711  HPW  Forecasting  CTC 
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Recent  Transitions 


W 


•  AF  Minerva  Princeton  Project: 

-  Direct  transition  to  COIN  efforts  for  ISAF,  heavily  cited  in  the  2011  Foreign 
Relations  Committee  Report  on  Aid  in  Afghanistan 

-  Briefings  to  Gen  McChrystal,  Chairman  of  the  Joint  Chief  of  Staff,  ISAF, 
DARPA 

-  Lyall  -  airpower  study  transitioned  to  the  Air  Combat  Command/Air  Force 
Targeting  Center 

•  UCLA  MURI  used  by  predictive  policing  unit  in  CA  (featured  on  ABC/NBC 
news) 

-  Transitioning  to  711  HPW  Forecasting  CTC 

•  Yaneer  Bar- Yam  -  Statistical  models  of  geographic/ethnic  boundaries  &  link 
between  food  costs  and  riots  presented  to  Strategic  Multi-layer  Assessment 
community  -  Warfighters  in  the  MISO  domain 

•  Cited  in  Top  10  Science  Discoveries  of  2011  by  Wired  Magazine! 

•  Sandy  Pentland  -  computational  methods  applied  in  the  DARPA  Nexus  7 
initiative 

•  Sacred  values  work  has  transitioned  to  the  Navy  and  DARPA  impacting 
national  policies  -  U.S.  Senate,  U.S.  State  Dept.,  House  of  Lords,  DARPA 
(Featured  in  Time  magazine  article  on  Gaddafi) 


Greg  Burn^i-F|^i!j(fAo^io^yubgf ^i^cej^raged  by  DARPA 


Trust 

ARL:  Trust  work  related  to  interfaces,  robotics,  networks 
ARI:  Trust  in  networked  teams 

NICTA:  Funding  technology  development,  some  work  on  trust  and  cognitive  load 

NAVAIR:  Trust  &  culture  interests 

IARPA:  Funding  large  trust  initiative  on  physiology  of  trust 

ONR:  Machine  Ethics 

AFRL:  Trust  is  a  core  research  area  -  close  collaboration  with  6.1  and  6.2 
Influence 

ONR:  Close  collaboration,  co-funding 

ARO:  Training,  mission  rehearsal,  face-to-face  negotiation/interaction,  etc.  Focus 
on  near-term:  “something  for  the  soldier” 

DARPA:  Interest  in  culture  but  more  focused  on  neuroscience  and  training 

OSD  HSCB:  Modeling,  ops  analysis,  training  (mainly  6. 2-6.3) 

Dept,  of  State:  Social  Media  interests,  possible  co-funding 

Air  University  Culture  &  Language  Center:  focus  is  mainly  on  training  related  to 
language  and  culture 

Defense  Equal  Opportunity  Management  Institute:  focused  on  cultural  training 
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